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Abstract 



We prove a version of the maximum principle, in the sense of Pontryagin, for the optimal 
control of a stochastic partial differential equation driven by a finite dimensional Wiener 
process. The equation is formulated in a semi-abstract form that allows direct applications 
■ to a large class of controlled stochastic parabolic equations. We allow for a diffusion coefficient 

^SJ I dependent on the control parameter, and the space of control actions is general, so that in 

. particular we need to introduce two adjoint processes. The second adjoint process takes 

' values in a suitable space of operators on L*. 

o ■ 
m 



1 Introduction 

Tlie problem of finding sufficient conditions for optimality for a stochastic optimal control prob- 
lem with infinite dimensional state equation, along the fines of tfie Pontryagin maximum prin- 
ce' ciple, was already addressed in the early 80's in the pioneering paper [1]. 

Despite the fact that the finite dimensional analogue of the problem has been solved, in 
complete generality, more than 20 years ago (see the well known paper by S. Peng pTSj) the 
infinite dimensional case still has important open issues both on the side of the generality of 
the abstract model and on the side of its applicability to systems modeled by stochastic partial 
differential equations (SPDEs). 

In particular, whereas the Pontryagin maximum principle for infinite dimensional stochastic 
control problems is a well known result as far as the control domain is convex (or the diffusion 
does not depend on the control) , see [U |8] , for the general case (that is when the control domain 
need not be convex and the diffusion coefficient can contain a control variable) existing results 
are limited to abstract evolution equations under assumptions that are not satisfied by the large 
majority of concrete SPDEs. 

The technical obstruction is related to the fact that (as it was pointed out in ^13j) if the control 
domain is not convex the optimal control has to be perturbed by the so called "spike variation" . 
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Then if the control enters the diffusion, the irregularity in time of the Brownian trajectories 
imposes to take into account a second variation process. Thus the stochastic maximum principle 
has to involve an adjoint process for the second variation. In the finite dimensional case such a 
process can be characterized as the solution of a matrix valued backward stochastic differential 
equation (BSDE) while in the infinite dimensional case the process naturally lives in a non- 
Hilbertian space of operators and its characterization is much more difficult. Moreover the 
applicability of the abstract results to concrete controlled SPDEs is another delicate step due 
to the specific difficulties that they involve such as the lack of regularity of Nemytskii-type 
coefficients in LP spaces. 

The present results (that were anticipated in the 6th International Symposium on BSDEs 
and Applications - Los Angeles, 2011 - and published in a short version in [5]) are, as far as 
we know, the only ones that can cover, for instance, a controlled stochastic heat equation (with 
finite dimensional noise) such as: 

' m 

dXt{x) = AXt{x)dt + b{x,Xt{x),ut)dt + ^aj{x,Xt{x),ut)df3i, t£[0,T],x£O, 

' i=i 
. Xo{x) = xo(x), 

(1.1) 

with A = Ax with appropriate boundary conditions, and a cost functional as follows: 

J{u)=e[ [ l{x,Xt{x),ut)dxdt + E [ h{x, Xt{x)) dx, 
Jo Jo Jo 

O C being a bounded open set with regular boundary. 

We stress the fact that in this paper the state equation is formulated, as above, only in a 
semi-abstract way in order, on one side, to cope with all the difficulties carried by the concrete 
non-linearities and on the other to take advantage of the regularizing properties of the leading 
elliptic operator. 

Concerning other results on the infinite dimensional stochastic Pontryagin maximum prin- 
ciple, as we already mentioned in [T] and [8] the case of diffusion independent on the control is 
treated (with the difference that in p] a complete characterization of the adjoint process to the 
first variation as the unique mild solution to a suitable BSDE is achieved). Then in [19j the 
case of linear state equation and cost functional is addressed. In this case as well, the second 
variation process is not needed. 

The pioneering paper [14J is the first one in which the general case is addressed with, in 
addition, a general class of noises possibly with jumps. The adjoint process of the second vari- 
ation (^t)tg[o,T] is characterized as the solution of a BSDE in the (Hilbertian) space of Hilbert 
Schmidt operators. This forces to assume a very strong regularity on the abstract state equation 
and control functional that prevents application of the general results to SPDEs. Recently in 
[lOj Pt was characterized as "transposition solution" of a backward stochastic evolution equation 
in C{L'^{0)). Coefficients are required to be twice Frechet-differentiable as operators in L'^{0). 
Finally even more recently in a couple of preprints [3] [1] the process Pt is characterized in a 
similar way as it is in [5] and here. Roughly speaking it is characterized as a suitable stochastic 
bilinear form (see relation (15. 6p ). As it is the case in [IDJ, in [3] and [4] as well the regularity 
assumptions on the coefficients are too restrictive to apply directly the general results to con- 
trolled SPDEs. On the other side in [4j an unbounded diffusion term is included in the model 
that can not be covered by the present results. Finally other variants of the problem have been 
studied. For instance in [6] a maximum principle for a SPDE with noise and control on the 
boundary but control independent diffusion is addressed, see also |TT] for a case with delay. 
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The paper is structured as follows. In Section 2 we fix notations and standing assumptions. 
In Section 3 we state the main result. In Section 4 we recall the spike variation technique 
and introduce the first variation process, the corresponding adjoint process and the second 
variation process together with crucial estimates on them. We stress here the fact that the 
structure of the second variation process forces to develop a theory in the LP spaces for the state 
equation and its perturbations through spike variation. In section 5 we complete the proof of 
the stochastic maximum principle. This is achieved by characterizing the adjoint of the second 
variation as a progressive process {Pt)t<^[Q^T] with values in the space of linear bounded operators 

— >• [L^Y = L'^/^ . Namely Pt is defined through the stochastic bilinear form 

{Ptf, g) = E-^* {HsY'/X'') ds + E"^^ {hY^'^ ,Y^'') , P - a.s. 

t f 

where (1^ )sG[t,T] is the mild solution of a suitable infinite dimensional forward stochastic equa- 
tion (see equation (jS.ip ). The study of the regularity of process iPt)te[o,T] is one of the main 
technical issues of this paper (together with the IP estimates of the first and second variations) 
and exploits the specific properties of the semigroup generated by the elliptic differential opera- 
tor. Finally in the Appendix we report some results on stochastic integration in spaces. For 
the reader's convenience we give complete and direct proofs of some results (including a version 
of the Ito inequality, see (|A.ip ). Such results are particular cases of the ones obtained in the 
framework of stochastic calculus in UMD Banach spaces, see |17j . 



2 Notations and preliminaries 

We begin by formulating an abstract form of the controlled PDF. 

Let {D, T>, m) be a measure space with finite measure (in the applications D is an open subset 
of and m is the Lebesgue measure). We will consider the usual real spaces U'{D,'D,m), 
p S [l,oo), which are shortly denoted by IP and endowed with the usual norm || • ||p. 

Let {Wi, . . . , Wf)t>o be a standard, d-dimensional Wiener process defined in some complete 
probability space {Q,J^,F). We denote by {Ft)t>o the corresponding natural filtration, aug- 
mented in the usual way, and we denote by V the progressive cr-algebra on 17 x [0, oo) (or on a 
finite interval [0,T], by abuse of notation). We will assume that there exist regular conditional 
probabilities P(-|J-() given any Tt- this holds for instance if the Wiener process is canonically 
realized on the space of M'^-valued continuous functions. 

As the space of control actions we take a separable metric space U , endowed with its Borel 
(T-algebra B{U). In general, we denote ^(A) the Borel c-algebra of any topological space A. 
We fix a finite time horizon T > and by a control process we mean any progressive process 
(ut)fg[o^T] with values in U . 

We consider the following controlled stochastic equation: 



dXtix) = AXt{x) dt + b{t, X, Xt{x),ut) dt + ^' Mx),ut) dW^ , 

Xo{x) = xo{x) 



(2.1) 



and the cost functional 



J{u)=e[ [ l{t,x,Xt{x),ut)m{dx)dt + E [ h{x, Xt{x)) m{dx). (2.2) 
Jo Jd Jd 

A control process u is called optimal if it minimizes the cost over all control processes. Denoting 
by X the corresponding trajectory we say that {u, X) is an optimal pair. 
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Hypothesis 2.1 1. The operator A is the infinitesimal generator of a strongly continuous 
semigroup {e^^)t>o of linear bounded operators on L^. We assume that there exist constants 
p>8 and M >0 such that for p £ [2,p] we have e*^(LP) C and ||e*^/||p < M||/||p for 
every t S [0, T] and f G L^. 

2. For (j) = b or (j) = I or (j) = aj, j = 1, . . . ,d, the functions 

(t>{uj, t,x,r,u) :Qx[0,T]x D xRxU ^R, h{uj, x,r) : U x D x R ^ R, 

are assumed to be measurable with respect to V (^"D B(R) (S> B(U) and B(R) (respectively, 
J^T®T>(g)B{R) andB{R)). 

3. For every {u},t,x,u), the functions r i— )• (l){uj,t, x,r,u) and r i— )• h{uj,x,r) are continuous 
and have first and second derivatives, denoted cp' and cp" (respectively, h' and h" ), which 
are also continuous functions of r. We also assume that 

{\(t)'\ + \(t)"\ + \h'\ + \h"\){uj,t,x,r,u) < K, 

M + \h\){u,t,x,r,u) < K{\r\ + \^{x)\), 
for some constant K, some ip £ and for all {u},t,x,r,u). 

4- XQ £ LP. 

From now on we adopt the convention of summation over repeated indices, so that we will 
drop the symbol Yl'j=i (|^-1P - 

Under the stated assumptions, for every control process u there exists a unique solution of 
the state equation (12. ip in the so-called mild sense, i.e. an adapted process {Xt)te[o,T] with 
values in L^, with continuous trajectories, satisfying P-a.s. 

Xt = e'^xo+ f e^'-'^Ms,;Xs{-),Us)ds+ f e^'-'^^aj{s, Xs{-),Us) dW^ , t e [0,T]. 
Jo Jo 

(2.3) 

Here and below, equalities like (|2.3p are understood to hold m-a.e., and uniqueness is understood 
up to modification of L^-valued random processes. 

We need to prove the following higher summability property of trajectories. We introduce 
the notation 

|||X|||p= sup (E||Xt||pVP. (2.4) 

ie[o,r] 

Proposition 2.2 For every p £ [2,p], iXt)t£[o,T] ^-^ progressive process with values in LP, 
satisfying sup^gjo.T] IE||Xt||p < oo. 

Proof. We consider the Banach space of progressive L^-valued processes (^t)tg[o,T] such that 
the norm |||X|||p is finite. For such a process X we define 

T{X)t = e'\o+ f e^'-'^Ms,;Xs{-),Us)ds+ f e^'-'^%{s, X,{-),Us) dW^ . 
Jo Jo 

It can be proved that the map F is a contraction with respect to the norm ||| • provided T 
is sufficiently small. Its unique fixed point is then the required solution. The restriction on T is 
then removed in a standard way by subdividing [0, T] into appropriate subintervals. 
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The fact that F is a well defined contraction follows from moment estimates of the stochastic 
integrals in . We limit ourselves to showing the contraction property assuming for simplicity 
6 = 0. In this case, if |||X|||p + |||5^|||p < oo, we have by ()A.2p 

Using the L^-boundedness of e*"^ and the Lipschitz character of a which follows from Hypothesis 
12.11 -3 we obtain 

E||r(X)t - T{Y)t\\l < C TeIIX, - YsW'Pds t'^P-^^^ < C\\\X - Y\\\pTp/^ 

Jo 

for some constant C independent of T. The contraction property follows immediately for T 
sufficiently small. □ 



3 Statement of the main result 

3.1 Statement of the stochastic maximum principle 

For our main result we also need the following assumptions. 

Hypothesis 3.1 There exists a complete orthonormal basis (ej)j>i in Lp' which is also a Schauder 
basis of . 

Hypothesis 3.2 The restriction of (e*^)t>o to the space is a strongly continuous analytic 
semigroup and the domain of its infinitesimal generator is compactly embedded in L^. 

We note that Hypothesis [3TT] is satisfied for a large class of measure spaces {D, V, m), typically 
with a basis of Haar type. 

In the following a basic role will be played by the space of linear bounded operators — t- 
(L^)* = L^/^ endowed with the usual operator norm, that we simply denote by C. Clearly, C 
may be identified with the space of bounded bilinear forms on L^. The duality between g £ 
and h G L^/^ will be denoted {h,g). As it is customary when dealing with spaces of operators 
endowed with the operator norm, when considering random variables or processes with values 
in £, the latter will be endowed with the Borel cr- algebra of the weak topology (the weakest 
topology making all the functions T i— )• {T f,g) continuous, /, 5 E L^); note that this is in general 
different from the Borel u-algebra of the topology corresponding to the operator norm ||T||£. 

For u G U and X,p, , . . . , q'^ G L"^ denote 

Tiit, u,X,p,q^ , . . . , q'^) = / [l{t, x, X{x),u) + b{t, x, X{x),u)p{x) + aj{t, x, X{x),u)q^ (x)] m{dx) 

JD 

Theorem 3.3 Let {X,u) be an optimal pair. Then there exist progressive processes {Pt)te[o,T] 
and {ptjQtT ■ ■ ■:Qt)te[o,T]! with values in C and (L'^)'^^^ respectively, for which the following 
inequality holds, ¥-a.s. for a.e. t £ [0,T]: for every v £ U, 

'H{t,v,Xt,pt,qt,-- ■,qt) - 'H{t,ut,Xt,pt,qt, ■ ■ ■,qt) 

+-{Pt[aj{t,;Xt{-),v)-aj{t,;Xti-),ut)],aj{t,;Xt{-),v)-aj{t,;Xt{-),ut)) > 0. 

The process {p,q^, . . . , q'^) satisfies suptg[o^T] IE||pj||2 + E Jq^ Y^'j=i Ikt Hi < ^"-^ ^'^ 
unique solution to equation ()4.17p below. 

The process P satisfies supjg[o,T] -ll^ll^tlli < °^ '^'^^ ^•^ defined in Proposition 15.31 below 
(formula (|5.6|) ). 

{p,q^,. . . ,q'^) and P will be called the first and second adjoint process, respectively. 
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3.2 Application to stochastic PDEs of parabolic type 

The purpose of this short subsection is to show that the main result can be immediately applied 
to concrete cases of controlled stochastic PDE of parabolic type on domains of Euclidean space. 

Let Dhe a, bounded open subset of M"" with smooth boundary dD, and let m be the Lebesgue 
measure. Consider the following PDE of reaction-diffusion type 

r dXt{x) = AXt{x)dt + b{t,x,Xt{x),ut)dt + J2'l=i(^j{t,x,Xt{x),ut)dWii, te [0,T],x e D, 
I Xt{x) = 0, te [0,T],x e dD, 
[ Xo{x) = xo{x), X e D, 

(3.1) 

and the cost functional (12. 2p . In this example the Wiener process, the space of control actions and 
the space of control processes are as before; on the coefficients b, aj,l, h we make the assumptions 
of Hypothesis 12. H points 2 and 3; finally we suppose xq £ for some p > 8. 
We claim that all the conclusions of Theorem 13.31 hold true. 

Indeed, we can define the operator A = A as an unbounded operator in with domain 
H^{D)riHQ{D) (the standard Sobolev spaces). Then A generates a strongly continuous, analytic 
contraction semigroup in all the spaces L'^, 1 < p < oo, and the domain of A is compactly 
embedded: see e.g. jS] or [12]. Therefore Hypothesis 12. H point 1, and Hypothesis 13.21 hold true. 
Finally, Hypothesis 13.11 is verified by a Haar basis. 

By similar arguments instead of A one can consider more general operators of elliptic type 
with appropriate boundary conditions. 

4 The spike variation method and the first adjoint process 

Throughout this section we assume that Hypothesis 12.11 holds, whereas Hypotheses 13.11 and 13.21 
will be needed only starting from the next section. 

4.1 Spike variation method and expansion of the state and the cost 

Suppose that u is an optimal control and X the corresponding optimal trajectory. We fix 
to £ (0, T) and e > such that [to, to -\- e] C (0, T), we fix a control process v and we introduce 
in the usual way the spike variation process 

^ f vt, if t G [to,to + e], 
* \ ut, iit^ [to,to + e]. 

We denote by X'^ the trajectory corresponding to u''. We are going to construct two L^-valued 
stochastic processes, denoted and Z'', in such a way that the difference X — — — is 
small (in the sense of Proposition l4.4l below) and the difference of the cost functional J{u^) — J{u) 
can be expressed in an appropriate form involving Y'^ and up to a small remainder: see 
Proposition 14.51 
Define 

5^aj{t,x) = aj{t,x,Xt{x),ul) - aj{t,x,Xt{x),ut) 
and consider the stochastic PDE 

(iy/(x) = AY^'{x) dt + b'{t, x, Xt{x),ut)Yt'{x) dt 

+a'j{t, X, Xt{x),ut)Yt'{x) dWi + 6'aj{t, x) dW^ , (4.1) 
y^(x) = 0. 



6 



By the standard theory of stochastic evolution equations in Hilbert spaces, see e.g. [2], there 
exists a unique solution to (|4.ip in the mild sense, i.e. a progressive process (5^/)tg[o,T] with 
values in , satisfying sup^g^^T] E||y/||| < oo and, for every t G [0, T], 



= / e^'-'^^[b'{s,;X,{.),Us)Y^{.) + 5^b{s,-)]ds 

rt (4.2) 

+ / e^'-'^^[<j'^{sr,X,{-),Us)Y^{-) + 5'a^{s,-)]dWi, P - a.s. 
Jo 

For the sequel we need the following more precise result. 

Proposition 4.1 For every p G [2,p], {Yt)te[o,T] ^■^ o- progressive process with values in , 
satisfying 

|||y^|||p= sup (E||y/||P)i/P < C7ei/2^ 

tG[0,T] 

To prove this result we need the following lemma, that will be used several times. 
Lemma 4.2 Given V ® T) -measurable processes a,a,h>,/3^ consider the linear equation: 

dVt{x) = AVt{x) dt + a{t, x)Vt{x) dt + a{t, x) dt + P{t, x)Vt{x) dW^ + x) dW^ , 
Vo{x) = 0. 

(4.3) 

Suppose a,V bounded and p € [2,p]. Then the following holds. 

1. There exists a unique solution to (|4.3p in the mild sense, i.e. a progressive process (Vt)jg[o,T] 
with values in LP , satisfying 



tG[0,T] 

and, for every t G [0,T], 



p = sup (E||T4||p)Vp < c / {n\at\\lf/Pdt + C [ {nMl?'"] (4-4) 

SfO.Tl Jo \Jo J 



t rt 



Vt= / e'^'-'^^[a{s,-)Vs{-) + a{s,-)]ds+ e'^'-'^^[bj{s, ■)Vs{-) + ^' {s, ■)]dW^ , F-a.s. 



provided the right-hand side of (j4.4p is finite. 

2. If in addition sup^g^ ji] E(||aj||p+ < oo and a,V are supported in a time interval of 
length e, then 

sup (E||yt||pi/P<Ce sup (E||at||pi/P + CV^ sup (E||^t||pi/P. 
te[o,r] te[o,r] te[o,r] 

or equivalently 

|||^|||p<Ce|||a|||p + CV^|||/3|||p. (4.5) 

3. In the case p = 2 we have 

sup E\\Vtg<C rEWatgdt+C rE||A||2dt = C (||a||i.(^^^,[0^^]) + p||i2(^^^ 
te[Q,T] Jo Jo \ I ^ w \ 



(r2xDx[o,r])^ 
(4.6) 
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In ()4.4p . ()4.5p . ()4.6p ?«e set ||/3j||p := ||lp(_D;R<^)) ^^'^ constant C depends on the hounds 
on a,iP , on the semigroup (e*"^), and on p andT. 

Proof. We consider again the Banach space of progressive L^'-valued processes {Vt)t(^[Q^T] en- 
dowed with the norm = sup^g^ j'] ||p)^/P. By the same arguments as in the proof of 
Proposition 12.21 we can prove that the map F defined as 

V{V)t= [\(^~^)^a{s,-)Vs{-)ds+ f e^'-'^%{sr)Vs{-)dWi 



is a (linear) contraction with respect to the norm ||| • |||p, provided T is sufficiently small. 
Therefore there exists a unique solution V and it satisfies the inequality 

lll^^lllp < / e^-''^^a{s)ds\\\p + \\\ I e^-'^'^/d^ (s) dW^\\\p. 



The inequality (j4.4p follows from an estimate of those stochastic integrals, using (jA.ip and 
the L^-boundedness of e*"^. The restriction on T is then removed by subdividing [0,T] into 
appropriate subintervals. Finally, ()4.5p and (j4.6p follow from (j4.4p and the Holder inequality. 
□ 

Proof of Proposition 14.11 This is an immediate corollary of the previous lemma, noting that 
lll'^'^o'jlllp < C as a consequence of the linear growth condition on aj (Hypothesis 12.11 -4) and the 
fact that |||X|||p < oo by Proposition 12. 2[ □ 

Define 

5^b{t,x) = b{t,x,Xt{x),ul) - b{t,x,Xt{x),ut), 

5'b'{t,x) = b'{t,x,Xt{x),ul) -b'{t,x,Xt{x),ut), 

6''a'j(t,x) = a'j{t,x,Xt{x),ul) - a'j{t,x,Xt{x),ut), 

and consider the following stochastic PDE: 

dZ^{x) = AZ^{x)dt + b'{t,x,Xt{x),ut)Zl{x)dt 

+h"{t, X, Xt{x), ut)Yt'{xf dt + 6'b{t, x) dt + 6'b'{t, x)Yt'{x) dt 
+a',{t,x,Xt{x),ut)Zl{x)dW^ + -a';{t,x,Xt{x),ut)Yi{xfdWi (^.7) 

+5v;.(t,x)y/(x) dwi, 

I = 



By the standard theory there exists a unique solution to (14. 7p in the mild sense, i.e. a progressive 
process (^j )te[o,T] with values in L?, satisfying supjg[o,T] ^ll^t Hi < and, for every t G [0,T], 

Zt = f e(*-^)^[6'(s, ., X,(.), n,)Z|(.) + \b"{s, •, X,(.), n,)y/(f + 5^b{s, ■) + 6^b'{s, ■)Y,^{-)] ds 



2 

e^'-'^^[a'^{s,.,X,{.),Us)Zl{.) + ^a'^{s,.,X,{.),Us)Y:{f + 6^a'^{s,-^^^^ 

(4.8) 

For the sequel we need the following result. 

Proposition 4.3 For every p € [2,p/2], (.^DtGlo.T] o, progressive process with values in L^, 
satisfying 

|||Z^|||p= sup {E\\Z't\\Py/P <Ce. 
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Proof. The result follows from Lemma 14.21 applied to equation ()4.7p . In particular inequality 
(fO|) shows that 



\Z'\\\p < C rm\h''{t,Xt,ut)inf + 6'b{t) + 6'b'{t)YtX)'^''dt 

JO ^ 1 /n 



2p ^ "-'f) 



The proof is now concluded estimating the right-hand side of this inequality. 
Since \\a"{t,Xt,ut){m% < C\m)X = 0^11% we have 

/ .T X 1/2 / X 1/2 

by Proposition 14.11 since 2p < p. 

Next we note that |||(^'^^|||p < C, as a consequence of the linear growth condition on b 
(Hypothesis 12.11 -3) and the fact that |||X|||p < oo by Proposition 12.21 Since 6^b is supported in 
[to, to + e] it follows that {E\\6%t)\\P)^/Pdt < Ce. 

The other terms are treated in a similar way. □ 

Proposition 4.4 We have 

sup (E||Xr-Xt-y/-Z,^||2)i/2 = o(e). 
te[o,T] 

As usual, o(e) denotes any function of e such that o(e)/e — )• as e — )• 0. During the proof 
we will use the Taylor formula in the following form: for a twice continuously differentiable real 
function g on M, and for r,h GM, 

g{r + h)=g{r)+g'{r)h+ f [ g" {r + Xfih) fidXdfih^ . (4.9) 

Jo Jo 

Since fidXdiu, = 1/2 this can also be written 

g{r + h)=gir)+g'ir)h + lg"ir)h''+ [ [\g" (r + Xfih) - g" (r)] fidXdfi . (4.10) 

^ Jo Jo 

Proof. We set R"^ = + Z'^. We first show that X + i?*^ is a solution of the following 
equation in L^: 

Xt + Rl = e*^xo + f e(*-^)^6(s, •,X,(-) + Rl{-),Us) ds - f e^'-'^^G'{s, •) ds 

ft ft (4.11) 

+ / e^'-'^^^aj{s,;X,i.) + Rli.),u,)dW^- e(*-^)^A^.(5, •) dl^i, 
Jo Jo 

where G' = G^'^ + G^'^ + G^'^, = A}'^ + A}'^ + A}'^ 

G''\s,x)= [ [ [b"{s,x,Xs{x) + XfiRl{x),ul)-b"{s,x,Xs{x),Us)]fidXdnRl{x)^, 
Jo Jo 

G''\s,x) = -b"{s,x,Xs{x),Us) {Zlixf + 2Y,'{x)ZI{x)), G''\s,x) = 6'b'{s,x)ZI{x), 



A^-'^(s,x)= / / [aj{s,x,Xs{x) + XfiRl{x),ul) - aj{s,x,Xs{x),Us)]fidXdfj,Rl{x)'^, 
Jo Jo 

Afis,x) = -a]is,x,Xs{x),Us) (Ztixf + 2Y,'ix)Zlix)), Af{s,x) = 5'a'j{s,x)Zlix). 
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To verify (j4.1ip we use the Taylor formula ()4.9p and obtain 

b{s,x,Xs{x) + Rl{x),ul) = b{s,x,Xs{x),ul) + b'{s,x,Xs{x),ul)Rl{x) 



+ 



[ [ b"{s,x,Xs{x) + XfiRl{x),ul) f^dXdnRl{xf,{4:.l2) 
Jo Jo 

aj{s,x,Xs{x) + Rl{x),ul) = aj{s,x,Xs{x),ul) + aj{s,x,Xs{x),ul)Rl{x) 

+ [ [ a]{s,x,Xs{x) + XfiRl{x),ul) ndXdfiRlixfiA.U) 
Jo Jo 

We apply e^*"*)"^ to (|4.12p and integrate /q ds, we apply e^*"'')^ to (|4.13p and integrate /q dWi , 
and we add the resulting equalities. Comparing with (|2.3p . (j4.2p and (j4.8p we obtain (|4.1ip . 
Since X^ is the trajectory corresponding to u*^ we have 

Jo Jo 
Comparing with (|4.1ip we see that := X^ — X — R'' solves 

^.1= f e'^'-'^H'{s,-)K{-)ds+ f e^^-'^^G'{sr)ds 
t t 

+ [ e^'-'^^a^jis,-)Ali-)dWi+ [ e(*-^)%^(s, •) dW^i, 
Jo Jo 

where ^ 

6'(s,x)= / b'{s,x,Xs{x) + Rl{x) + XAl{x),ul)dX, 
Jo , 



aj[s,x) 



[ a'As,x,Xs{x) + Rl (x) + AA^ (x) , dX, 
Jo 



are bounded coefficients, uniformly in e. We can then apply Lemma r4.2l and specifically inequality 
(j4.6p arriving at 



sup (E||X,^-Xi-y/-Z,l2)i/2= sup IE||A^i<C(||Gii.(^,^,[o^^]) + ||A^||i.(^,^,[o_^])). 

tG[0,T] ie[0,T] 

To finish the proof it remains to verify that the L^{n x Dx [0,T]) -norm of each term G*^'*, A^' 
(i = 1,2,3) is o(e). 

Let us verify that ||G'^'"'^||/^2(f^x_Dx[o,T]) = o(e). Write G'^'^{t,x) = Ql{x)Rl{x)'^ where 

Ql{x) = [ [ [b"{t,x,Xt{x) + XfiRt{x),ul)-b"{t,x,Xt{x),ut)]fidXdfi. 
Jo Jo 

Next take p G (2,p/4], which is possible because p > 8, and let q > 1 be such that | = ^ + ^• 
Then 

iiG^'i 

L'3(nxDx[0,T])ll(-R^) llLP(f2xDx[0,T])- 

Since 

IK^TII LP{nxDx[0,T]) — \m\ < cwmwi < cm'\\\% + \m\\%) < c{e+e') 

by Propositions 14.11 and 14.31 it remains to show that ||(5'^||L9(rjx_Dx[o.T]) — ?• as e — )• 0. We argue 
by contradiction: assume that there exists 6 > and a sequence — t- such that 



rT 



E 



10 JD 



-I rl 



[b"{t, X, Xt{x) + XtiRt{x),ul) - b"(t, X, Xt{x),ut)] ^idXdjs 



10 Jo 



m{dx)dt > 6. 

(4.14) 
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Since ||-R'^||l2(qxZ)x[o,t]) ^ C'|||i?'^|||2 < C(|||y^|||2 + |||Z'^|||2) — >• 0, there exists a subsequence 
Cuf. such that R'^^k — j. a.s. with respect to the product measure ¥{duj)m{dx)dt. Since r i— t- 
b"{t, X, r, u) is continuous, and due to the special definition of u^, it follows that b"{t, x, Xt{x) + 
A/ii?^"* (x), n^"'° ) — )• b" {t, X, Xt{x),ut) a.s. with respect to 

F{duj)m{dx)dtdXdiJ,. By dominated convergence this contradicts (|4.14|) . 

The proof that ||A^'^||^2(f2xDx[o,T]) — ^ is identical. The other terms C^'*, A^'* are treated in 
a standard way using Propositions 14.11 and 14.31 □ 

Define 

6H{t,x) = l{t,x,Xt{x),ul) - l{t,x,Xt{x),ut), 
6H'{t,x) = l'{t,x,Xt(x),ul) -l'{t,x,Xt{x),ut). 

Proposition 4.5 We have 

l-T 



J{u') - J{u) =E [ [ 6H{t,x)m{dx)dt 
J, Jo Jd 

+E / / l'{t,x,Xt{x),ut)(Yt^{x) + Z't{x))m{dx)dt 
Jo Jd 

/ / l"{t,x,Xt{x),ut)Yt'{xfm{dx)dt 



JD 



+E / h'{x, Xtix))(Y^{x) + Z^{x)) m{dx) + / XT{x))Y^{xf m{dx) + o(e). 

Jd 2 

(4.15) 

Proof. We still denote = Y^ + Z^. We have 

J{u') - J{u) =E [ [ [l{t,x,X^{x),ul) -l{t,x,Xt{x),ut)]m{dx)dt 
Jo Jd 



+E / [h{x,X^{x)) - h{x,XTix))]m{dx). 



D 



We first consider 





= E 


A2 


= E 


A3 


= E 



e/" / [l{t,x,X^{x),ul) -l{t,x,Xt{x),ut)]m{dx)dt = Ai + A2 + A3, 
Jo Jd 

where 

n[l{t, X, Xt{x),ul) - l{t, X, Xt{x) + Rl{x),ul)] m{dx) dt, 
D 

/ / [l{t,x,Xt{x) + Rl{x),ul)-l{t,x,Xt{x) + Rl{x),ut)]m{dx)dt, 
10 Jd 

n[l{t,x,Xt{x) + Rl{x),ut) - l{t,x,Xt{x),ut)] m{dx) dt. 

Prom Proposition 14.41 it follows that Ai = o{e). Next applying the Taylor formula ()4.9p twice in 
A2 we have 

^2 = E^ j (^6H{t,x) + 5H'{t,x)RI{x) 

^ lo L ^' ^^^^^ ^ ^f^Rtix)^ul) - l"{t, X, Xt{x) + XfiRl{x),ut)] fidXdfj, RUxf^ m{dx) dt 

= E [ [ 6'l{t,x)m{dx)dt + o{€), 
Jo Jd 
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as it follows easily from Propositions 14.31 and 14.31 Applying the Taylor formula ()4.10p we have 

A3 = E^ (^l'{t,x,Xt{x),ut)Rtix) + ^l"it,x,Xtix),ut)Rt{xf 
+ j j [l"{t,x,Xt{x) + Xfj,Rl{x),ut)-l"{t,x,Xt{x),ut)]fidXdfiRl{xf^m{dx)dt 
= E ^ ^ (^I'it, X, Xtix), ut)Rl{x) + ^r'(t, X, Xt{x),ut)Yt'{xf^ m{dx) dt + o(e). 
The last equality is verified noting that 

E /" / l"{t,x,Xt{x),ut){2Y^%x)Zl{x) + Zl{xf)m{dx)dt = o{e), 
Jo Jd 

by Propositions 14.31 and 14. 3| and that 



e/ [ ( [ [ [l"{t,x,Xt{x) + XfiRl{x),ut)-l"{t,x,Xt{x),ut)]fidXdfiRl{x)Am{dx)dt = o{e) 
Jo Jd \Jo Jo j 



which can be proved by the same arguments used to treat the term G"^'^ in the proof of Propo- 
sition 1331 

In a similar way one proves 

E I \h{x,X'r^{x))-h(x,XT{x))\m(dx) 
Jd 

= E [ h'{x,Xt{x)){Y^{x) + Z^x))m{dx) + -E [ h" {x, Xt{x))YS{x)^ m{dx) + o{e), 
Jd 2 j£) 

and the proof is finished. □ 
4.2 The first adjoint process 

The first adjoint process is defined as the solution of the backward stochastic PDE 

-dpt{x) = -dqi{x)dWt^ + [A*ptix) + b'{t,x,Xt{x),ut)ptix) 

+a'j{t, X, Xt{x),ut)4(.x) + l'{t, X, Xt{x),ut)] dt (4.16) 
Prix) = h'{x,XT{x)) 

where A* denotes the adjoint of A in L^. By the result in [7] there exists a unique solution, i.e. 
a progressive process {pt, q], . . . , qt)t&[o,T] with values in (L^)'^+^, such that 

sup E||pt||2+E j Y,\\ql\\ldt<^, 



ie[0,T] Jo 



and satisfying the equation in the mild sense: for every t G [0,T], 

(4.17) 

.^,s,-,Xs{-),Us)qi{-)+l'{s,-,Xs{-),Us)]ds, ¥-a.s. 
where {e^^ ) denotes the adjoint semigroup of (e*"^) in L^, which admits A* as its generator. 



Pt + f e^'-'^^'q^,dWi = e(^-*)^*/i'(-,XT(-)) + f e^'-'^^' [b' {s, Xs{-),ns)ps{-) 

+a'Js,-,Xs{-),Us)qi{-)+l'{s,-,Xs{-),Us)]ds, ¥ - a.s. 
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Proposition 4.6 Define 

H{t,x) = r'{t,x,Xt{x),ut) +pt{x)b"{t,x,Xt{x),ut) +ql{x)a'^{t,x,Xt{x),Ut), . 
h{x) = h"{x,XT{x)). ^ ■ ' 

Then we have 

J{u'')-J{u) = e[ I [5H{t,x) +pt{x)5%{t,x) + q{{x)5''aj{t,x)]dsm{dx) 

Jo Jq, 

+-E / / H{t,x)Yt'{xf dsm{dx) + -E I h{x)Y^{xf m{dx) + o{e). 
Proof. We claim that the fohowing duahty relations hold: 



E [ [ l'{t,x,Xt{x),ut)Yt^{x)m{dx)dt + E [ h'{x,Xtix))Y^{x)m{dx) 
Jo Jd ^ Jd 

= E / 5^aj{t,x)ql{x)m{dx)dt, 
Jo Jd 



(4.19) 



E / / l'{t,x,Xt{x),ut)Zl{x)m{dx)dt + E [ h' (x, Xt{x))Z^{x) m{dx) 
Jo Jd ^ Jd 

= E [ [ [6'b{t,x) + h"{t,x,Xt{x),ut)Yt'{xf + 5'b\t,x)Yt'{x)]pt{x)m{dx)dt (4.20) 
J^ Jd 2 

+E [ [ [^a''it,x,Xtix),Ut)Yt'{xf + 6'a'jit,x)Yt'{x)]qi{x)midx)dt. 
Jo Jd 2 

If A is a bounded operator and equations (|4.ip and (j4.7p are valid in the sense of Ito differentials 
in then (I4.19P and (I4.20p follow from an application of the Ito formula to the processes 
{Y^,pt)i2 and {Z^,pt)i2 respectively, where {■■,■) l2 denotes the scalar product in L^. In the 
general case a regularization procedure is needed, where in particular the operator A is replaced 
by its Yosida approximation An and then n — )• oo. We omit writing down this standard part of 
the proof: one can find the details of these arguments (applied to BSDEs) in [16j or (applied to 
forward SDEs and control problems) in [15]. One can also look at Subsection 15.21 below where 
we use similar arguments in a more complicated setting. 

Now the proof is concluded substituting (j4.19p and (|4.20p in (j4.15p , provided we can prove 

T (■ f-T 



E 6'b'{t,x)Yt'{x)ptix)m{dx)dt = o{e), E 6'aj{t,x)Y^'ix)ql{x) m(dx) dt = o{e). 

Jo Jd Jo Jd 

Since the proof is very similar, we only prove the second equality. Since d'^a'j is bounded and 
supported in [to, to + e] we have, using the Holder inequality and recalling the norm ||| • 
introduced in (12. 4p . 



e[ [ 5'<j]{t,x)Yi{x)ql{x)m{dx)dt <CE f l[t,M+4tWthhthdt 
Jo JD Jo 

<C7|||yi||2^ i[to,to+e]W(iE|kti)'/'dt<C7|||y^|||2^ i[,„,,„+,](t)E||(7tidtJ v^. 



The last integral tends to as e — )• 0, since E \\qt\\2 dt < oo. It follows that the right-hand 
side is o(e), because |||y^|||2 < C by Proposition 14.11 □ 
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4.3 Some formal computations and heuristics 

In order to motivate some of the constructions below, and to make a connection with the finite- 
dimensional case treated in [13], in this paragraph we proceed in a formal way. 
We wish to prove that 

E / / H{t,x)Yt%xf dsm{dx) +^ f h{x)Y^{xf m{dx) 
Jo Jd (4.21) 



E / {Pt5'ajit,-),S'a,it,-))L^dt + oie), 
Jo 



for an appropriate operator- valued process Pj. In view of Proposition 14.61 the stochastic maxi- 
mum principle then can be shown to hold by the usual arguments as in [13] or |18j . 

We denote by Hf the multiplication operator by the function H{t, •) and by h the multipli- 
cation operator by the function h{-). We pretend that they are bounded operators on the space 

Next we consider the operator-valued BSDE 

-dPt = -Qi dWl + [A*Pt + PtA + BtPt + PtBt + CiPtCi + CiQi + Q^C/ + Ht] dt 
Pt = h, 

(4.22) 

where by Bt, C| we denote the (self-adjoint) multiplication operators by b'{t,-,Xt{-),ut) and 
(Tj (t, •, Xt(-), n^) respectively. Suppose that we can find a good solution in the space of bounded 
linear operators on L^. Then applying the Ito formula to {PtYf,Y^)i2, integrating from to T 
and taking expectations we obtain 

E j^{HtYt',Yt')L2dt + E{hY^,YS)L2=^ [{Pt6'a,{t,-),S'aj{t,-))L^ 
+2{Pt6%t, •),y/)L2 + 2{PtCiY^\6%t, ■))l2 - 2{QiYt\6'aj{t, •))l2] dt. 

If we were able to prove, in analogy with the finite-dimensional case, that 
rT 



E 



/ [2{Pt5%t, •), + 2{PtC{n, 6%t, ■))l2 - 2{Q{yI, 5'a,{t, ■))l2] dt = o(e), 
Jo 



then (j4.2ip would follow and the proof would be finished. However in this argument finding a 
solution of the operator- valued BSDE (I4.22P that allows to make the previous argument rigorous 

seems a very difficult task. So we follow a different strategy of proof, that we outline below. 

t f 

For fixed t G [0,T] and f ^ H, denote by {Yg )s^[t^T] the mild solution to 
f dYj'f{x) = AY^^^f {x)ds + h'{s,x,Xs{x),Us)Yj'f {x)ds + cj'^{s,x,Xs{x),Us)Y^s'^ {x)dWi, 

\ y/'^(x) = f{x) 

This equation has to be compared with (j4.ip . 

Then taking g G L^, applying the Ito formula to {PgYg'-^ ,Ys'^) x^2 over the interval [t,T], 
integrating from t to T and taking conditional expectation given J^t we formally obtain 

(PJ,5>L2 = E^^ j\HsY^''fX'')L^ds + E^^hY^'f,Y^^')L2 

= E^' [ [ H{s,x)Y,y{x)Y^''^{x)m{dx)ds + E^' [ h{x)Y^'^ {x)Y^'^ (x) m{dx). 
Jt Jd Jd 

(4.23) 
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The interesting fact is that this formula can be used to define Pt. more precisely, in Proposition 
15.21 below, we will prove that if / G then {Ys'^)s(i 2-] is a progressive process with values in 
L^, satisfying 

sup (E-^iy/'/||^)i/4 < C7||/||4. 

sG[t,T] 

As a consequence we will show that the right-hand side of ()4.23p defines a continuous bilinear 
form on (or equivalently a linear bounded operator from to L^/^ = (L^)*) and we will set, 
for f,g&L\ 

{PJ,g)=E^' [ [ H{s,x)Y^^^^x)Y,^^^x)m{dx)ds + E^' [ /i(x)y^'^(x)y^'^(x) m(dx). 
Jt Jd Jd 

Note that no reference to the BSDE ()4.22p is needed to give this definition. Finally, it turns out 
that ()4.2ip can be proved to hold with this definition of Pf. 



5 End of the proof of the stochastic maximum principle 

As explained above, we are going to introduce the second adjoint process, an appropriate 
operator- valued process (Pt) that will allow us to conclude the proof of Theorem 13.31 

Throughout this section we assume that Hvpotheses 12.11 [3TT] and [3^ are satisfied. 

The symbols (e*'^)t>o and A will also denote the restriction of the semigroup to the space 
and its infinitesimal generator in L'*. We need to recall some standard facts and constructions 
on analytic semigroups: see for instance [12] or [9]. Without loss of generality we can assume 
that A is boundedly invertible (if not, we replace A hy A — cl for sufficiently large constant 
c > and we modify the drift coefficient accordingly). The domain of A is endowed with the 
norm ||/||_d(A) ■= ll^/IU- By the analyticity assumption, one can define the fractional powers 
(— ^4)'' of —A in a standard way, for every r] G (0,1). Each fractional power is a linear, in 
general unbounded, operator in L^, with domain denoted D(—A)^. Endowed with the norm 
:= II (— ^)''/||4, each space D{—A)'^ is a Banach space and we have the continuous 
embeddings 

D{A) C D{-Ay' C D{-Ay C L^ < p < rj < 1. 

By analyticity, e*^(L^) C D{A) for every t > 0, and for every < 77 < 1 there exist constants 
Cl, Cr, > such that for every f € L'^ and t G (0, T], 

We'^fWniA) = WAe'^fh < ^ll/IU, \\e'^f\\D(-A). = ||(-^)^e*^/||4 < ^Wfh- 

Finally, as a consequence of the compact embedding D{A) C L'^, every embedding D{—Ay C 
is also compact, < r] < 1. 

Remark 5.1 In most of what follows, we will only use the estimate ||(-^)''e*^/||4 < §^||/||4 
and the compact embedding D{—Ay C for one, sufficiently small value of ry > 0. This might 
eventually lead to a weakening of Hypothesis 13. 2^ but we not discuss those extensions in this 
paper. 

For fixed t G [0,T] and / G L^, we consider the stochastic PDF 

dVs'^ix) = AY^'f (x) ds + b'{s, x, Xs{x),Us)Y^'^ (x) ds + a^(s, x, X,(x), n,)y,*'-^ (x) dW^ , 
F/'^(x) = fix). 

(5.1) 
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As a special case of Proposition 12.21 (with p = 4), for every t G [0,T] there exists a unique mild 
solution, i.e. an adapted process (ys*'''^)sG[t,T] with continuous trajectories in L^, satisfying P-a.s. 



J"- 

Jt Jt 
for every s G In addition we have supo<t<s<Tll^ll^s*'''^ll4 < oo. 

Proposition 5.2 There exists a constant C such that for f £ L'^, < t < s < T 

(E^iyy 11^)1/4 < dl/IU, p-a.s. (5.2) 
and forO <t <t + h< s <T 

(E||y W - lll)^/^ < C[ sup ||(e*^ - e(*+'^)^)/||4 + /i'/'H/lk]. (5.3) 

ie[o,T] 

Moreover for every t] G (0, 1/4) i/iere exists a constant Cq such that for f G D{—A)^ C L^, 
0<t<s<T 

(E-^* ||y^*.(-Ar/||4)i/4 < ^^(^ _ t)~'?||/||,, p _ a.c,. (5.4) 

We notice that the above relation indicates that equation \5. 1\) regularizes the initial data (roughly 
speaking sends data in D{—A)~''^ to L^. 

Proof. For brevity we write the proof in the case 5 = and denote by Cj (r) the multiplication 
operator in by the (bounded) function (y'j{r, ■, Xr{-),Ur)- So the equation for y*'^ is 

ytJ = e'^'-'^^f + e(^-")^C7j(r)y^*'^ dW^, s G [t, T]. 

Using the conditional inequality ()A.3p for p = 4 we obtain 

E-^* r e^'''^^^Cj{r)Y.y dW^ <C f\^'\\e^'"''^'^Cj{r)Y^^f\\\dr<C f\^'\\Y^^f\\\dr, 

Jt 4 Jt Jt 

and since 

||g(s-tM^||4 < C\\f\\\ it follows that for every s G [t,T] we have, P-a.s. 

E-^iyyil^ < C\\f\\i + C j\^^\\Yy\\ldr. (5.5) 

Take a dense countable set D C [t,T]. Then, P-a.s., (|5.5p holds simultaneously for every s £ D. 
Since y*'^ has continuous trajectories in L'^, there exists a set with P(A) = such that 
s — )• ||ys*'-^(a;)||4 is continuous on [t,T] for every co ^ N. Discarding a set of P-measure zero, and 
given any s G [t,T], we take a sequence (s„) C D, s„ — s and by the conditional Fatou Lemma 

E-^*||y*-^||i = E-^* liminf \\Y^'^\\l < liminf E-^*||y*'-^||i 

n— >cxD " n— s-oo " 

rs„ rs 

< C||/||^ + C7 liminf / E^'WY^ \\idr = C\\f\\i + C E^'\\Yy\\idr. 
Jt Jt 

It follows that, P-a.s. (|5.5p holds for every s G [t,T], so that (|5.2p follows from a pathwise 
application of Gronwall's lemma. 
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The proof of (j5.4p is very similar: by (|5.5p we have 



and ()5.4p follows again from a variant of Gronwall's lemma. 
To prove ()5.3p we first write, for s € + /i,T], 

+ r e(^-'')^Cj-(r)(y/+^'^ - ) dW} =:I + II + III. 

Jt+h 

Then we have, using ()A.2p for p = 4, 

||/||4< sup ||(e*^-e(*+'^)^)/||4, 
te[o,T] 



E||//||| < c/i^ E||y,*'^||^cir < ch^WfWi 



EWiiiwi < c I E||y/+'^'^ - yywi dr. 



t+h 



Therefore 



E||yW-yi'^||^ <c[ sup ||(e*^-e(*+'^)^)/||4 + /i'||/|||] + c T E||y w - y,*'^||| dr 

and (|5.3p follows from Gronwall's lemma. □ 

Recall that we denoted by C the space of linear bounded operators — ?■ (L^)* = L^/^ 
endowed with the usual operator norm and with the Borel cj-algebra of the weak topology. The 
duality between g G and h G L^/^ is denoted {h,g). We note that, by the Holder inequality, 
every H £ can be identified with the corresponding multiplication operator, i.e. with a 
unique H £ C satisfying 

{Hf,g)= [ H{x)f{x)g{x)m{dx), f,geL^ 
Jd 

and, moreover, < ll-f^lb- Similar remarks apply to H{t,x) and h{x) defined in (j4.18p . 

The definition of the second adjoint process P, along with some of its properties, is given in 
the following proposition. 

Proposition 5.3 There exists a progressive process iPt)te[OT] with values in C, such that for 
tG[0,T], f,geL\ 

{Ptf,g)=E^^ {HsY,yX'')ds + E^^hYy,Y^''), ¥-a.s. (5.6) 

We have 

sup E\\Pt\\l < oo, (5.7) 
te[o,T] 
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and for every f,g & L'^ we have, for e J, 0, 



n{Pt+,-Pt)f,g)\^Q. 



(5.8) 



Moreover, for every rj £ (0,1/4) there exists a constant such that for f,g£ D{—A)^ C L'^, 
0<t<T, 



\{P,(-Arf,{-Arg)\<Cr,\\fU9UT-t) 



-2r? 



1/2 

E^'WHsWlds] + (E- 



-^t||?;i|2)l/2 



which immediately implies 

Esuv{m{-Arf,{-A)^g)\^ : f,geD{-A)^,\\f\U<l,\\g\U<l} 
< C^iT-t)-'^" 



T 



E / \\H,\\lds + K\\h\\l 





r-a.s. 
(5.9) 

(5.10) 



Remark 5.4 1. Formula (j5.6p can be written more explicitly as follows: 

{Ptf,g)=E^' [ [ H{s,x)Y^^^{x)Y^^3{^x)m{dx)ds + E^' [ h{x)Y^f {x)Y^\x) m{dx). 
Jt Jd Jd 

Clearly, (|5.6p defines uniquely (Pt) up to modification. 
2. In the following, for T £ C we will use the notation 

\\\T\\\:=snp{\{T{-Arf,i-Arg)\ : f,geDi-Ay 

(j5.10p can then be written 



, \\j 114 < 1, lls-lk < 1 



} (5.11) 



E|||Pt||p < C7^(r-t)-^^ 



E / \\Hs\\lds + E\\h\\l 



(5.12) 



3. Note that for L^-valued, J-t-measurable random variables F, G we have 



{PtF, G) = E-^* / {HsYyX^'^) ds + E-^* {HY^' , F^'^), 



a.s. 



(5.13) 



The equality being trivial if F and G are simple random variables and easily passing to 
the limit. 



Proof of Proposition E31 Fix r/ G (0, 1/4), /,5 G i:»(-^)'' C L^, < t < T. Using the 
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conditional Holder inequality and (|5.4p we have 



rT 



\H 



s\\2 



|V*'(-^)''f|| 1 
Mti ||4j 



%(E^i/i||2f)i/2(E-^iy^'(-^)'^||4)V4(E-^t||y^.(-A)''9||4)i^ 
< c\\fUg\U ^ (E-^' \\Hs\\l)'/\s - t)-'^ ds + c||/||4||5||4(E-^* ll/^lbf )'/'(r - t)" 



2v 



<C||/||4||5||4 



/ _ \ / .T X 1/2 

E^^WHsWldsj {s-ty^'^ds] +{E^*\\h\\2f)^/\T-t) 



-2r) 



<c||/||4||5ll4(r-t) 



-2r) 



r _ X 1/2 

E^'WHsWlds] + (E-^i/i||2i 



(5.14) 

where c is a constant independent of f,g,t. Using ()5.2p instead of (|5.4p this inequality also holds 
for T] = 0. 

Now fix a dense set F in L''. For f,g^F let us define (Pt/, 5) by formula ()5.6p . by fixing an 
arbitrary version of the conditional expectations on the right-hand side. By (|5.14p with r] = 0, 
there exists a set N of probability zero such that for u ^ F we have 



KPtH/,g)| <c||/||4||5|| 



Thus, the mapping {f,g) 1— t- {Pt{uj)f,g) extends from F x F to a continuous bilinear form on 
(or equivalently an element of £), still denoted Pt{u!)- Set Pt{uj) = for a; G A^. Using 
again (j5.14p with = 0, it is easily proved that equality (|5.6p holds for every f,g £ L^, 
by approximating f,g with elements of F. Thus, an £-valued process {Pt)te[o,T] has been 
constructed with the required properties. (Pt) is adapted by construction. Similar arguments 
also show the existence of a progressive modification of (Pj), as required. 
(|5.9p follows at once from (j5.14p . (j5.14p with rj = gives 



\Pt\\ < c 



1/2 

E^'WHsWlds] +(E^' 



2^l/2 
2) 



which implies ([57 

It remains to prove 



We sketch the proof in the case h = for short. 



((Pi+, - Pt)f,g) = (E^*+^ - E^*) I {HsY'/X'S) ds 

-E-^*+' / {HsY,^'f,Y^^'3)ds + E^' / [(//,yi+^'-^,y,*+^'9) - (^,yy,y,*'9)]ds. 

The first summand tends to zero in L^{Q, P) by the downwards martingale convergence theorem, 
the third one due to ()5.3p and the second one is easy to treat by dominated convergence Theorem. 
□ 

We are now ready to finish the proof of our main result, by showing that the formula (j4.2ip 
introduced during our heuristic discussion actually holds (more precisely we will prove (j5.15p 
below) . 
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End of the proof of Theorem 13.31 We claim that the foUowing holds: 
rT pT 



E 



f {HsY^',Y^')ds + E(hYS,YS) =E [ {PsS'aj{s, ■),5'aj{s, ■)) ds + o{e). (5.15) 
Jo Jo 



Admitting this for a moment, if follows from Proposition 14.61 that 



T 



J{u^)-J{u) = E/ [6H{t,x)+pt{x)5^b{t,x) + qi{x)6''aj{t,x)]dsm{dx) 
Jo J,D 

+E / {Ps5'aj{s,-),S'aj{s,-))ds + oi€). 
Jo 

The optimality of u implies that J{u'') — J{u) > 0. Diving by e and letting e — )■ 0, the required 
conclusion is obtained by standard arguments, see e.g. [13] or [18] , 

So it only remains to prove (j5.15p . Recalling that 1^ = for s < to, the left-hand side of 
(j5.15p equals 

rto+e _ rT 

E / (i?,y/, y/) ds + E {HsY^, y/) ds + E{hYf, y^) . 

J to Jto+e 

It is easily checked that the first integral is o(e). Using the formula 

tn+t.Yf _i_ 

y/ = y/ '0+^, s>to + e, 
which follows by comparing the equations (15. Ih and (j4.ip satisfied by y*o+^'-^ and y^, we obtain 

E {HsY!,Y!)ds + E{hY^,Y^) 

= o(e) + E f {H,Yr''''^'^-^,Yr'''^^-^)ds + E{^^^^^^^ ^^-l^) 

= o(e) + E(Ao+.>^4+-^4+.)' 
where the last equality follows from an application of (I5.13p . Next we claim that 

E((Pi„+, - PtJ y^^,, y/„+,) = o(e), (5.17) 

E{Pt,Y,l^^,Y,l^^)=E f'^\PsS^a,{s,-),d^a,{s,-))ds + o{e). (5.18) 
J to 

The required formula (|5.15|) will now be a consequence of (|5.17|) and (j5.18|) . which are proved 
in the following two subsection below. The proof of Theorem 13.31 will then be finished. □ 

5.1 Proof of dHH]) 

It is convenient to rewrite (j5.17p in the form 

E((P<„+,-P<Je-i/2y4+„e-i/2y4+,) ^0. (5.19) 
By Proposition 14. 1 1 there exists a constant Co independent of e such that 

iE\\e-y'no^,\\t)'/' < Co, iE\\e-'/%l^,\\l)y' < Co- (5.20) 
Next we fix G (0, 1/4) and notice that for every 5 > we have, by the Markov inequality, 

p(||e-i/2(-A)-''y4+j^(_^). > Co6-'/') = P(||6-i/2y4+j4 > Co6-'/') < 6. 
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Therefore setting Ks = {f & : / G D{-Af, \\f\\D(-A)v < Cq^-^/^} and denoting n^,, the 
event {e-'^/'^{-AyW^l_^^ E Ks} we obtain 

mie) = n^-'/\-Ar^Y,i^, i ks) < s. 

We note that, since D{—A)^ is compactly embedded in L^, the set Ks is a compact subset of 
L^. Moreover, for / G Ks we have 

\\f\U<c\\f\\Di^A)v<cCo5-y\ (5.21) 

i.e. Ks is contained in a bah of centered at with radius proportional to 6~^^'^. 
We have 

=: A\+A\. 
By the Holder inequality 

1^11 < (E||P,„+,-P,J|i)V2(E||e-V2y^^„_,Jl)V4p(oyV4^ 

and from ([521), ([OOD we conclude that \A\\ < cP(0^ J^/^ < cJ^/'' for some constant c indepen- 
dent of 5 and e. 

On the other hand, recalling the definition of ^s,ei 

\A\\ < E sup \{{Pt,+, - Pt,) i-A^f, (-^)V)lo,,J. 

feKs 

Since Ks is compact in L^, it can be covered by a finite number A^^ of open balls with radius 
5 and centers denoted i = 1, . . . ,Ns. Since D{—A)'^ is dense in L^, we can assume that 
// G Given / G i^^, let i be such that ||/ - // 1|4 < (5; then writing 

-{{Pt,+. - Pt,){-A)^{f - //), {-A)^{f - //)) + 2((P,„+, - Pt,){-A)y, {-A)\f - // )) 
and recalling the notation introduced in (jS.lip we obtain 

K(P„+, - Pt,){-A)y, {-Aff)\ < K(p„+, - PtJi-A^ff, i-Arf!)\ 

+\\\P,^^,-P,J\S^ + 
Recalling (j5.2ip we conclude that 



+ \\\Pto+e - PtolWS' + 2|||Pi3+, - PiJII 11/114(5. 



Ns 

sup m,+, - Pt,) i-Arf, i-Aff) < ^m,+. - Pio)(-^)v/, (-^)v/>i 

+2 sup |||Pt|||j2 + c sup IllPtlllJ^/^, 

t&[to,to+t] t£[to,to+e] 

for some constant c. Taking expectation, it follows from (|5.12|) that 

\Al\ < Y,mPto+e - Pto){-Arf!, {-Arf!)\ + c{T -to- e)-'^[6' + S'/% 
1=1 

for some constant c independent of e and 6. By ()5.8p we conclude that 



limsup \A'2\<c{T- to)-^''[5^ + ,5^/^]. 
£4-0 

Letting (5 — >■ we obtain |Af | + l^ll ~^ ^^^^ proof of ()5.17p is finished. 
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5.2 Proof of (KT8\i 

In order to make appropriate computations on ^{Pt^ Y^^_^_^,Y^^^^) we perform an approximation 
of both Ptg and ^tg+e- 

To approximate Pt^ we use the basis {ei)i>i of Hypothesis 13. II We introduce the projection 
operators UnJ = '^f=i{f ■• ^1)2^-1, f S L^, where (•,-)2 denotes the scalar product of L^. Each 
IItv is an orthogonal projection in L^. Since we assume that (ej)j>i is a Schauder basis of L^, 
the restriction of Iljv to is a bounded linear operator in L^, satisfying ||nAr/ — /II4 — t- for 
every f £ and sup^ l|nAr||L(L4^^4) < 00. Then we define 

N 

Pf{u;)f := {Pt{uj)e^,ej){e,Jhej, f € L\ 

Then P^^ (uj) is a linear bounded operator on L^, which extends to a linear bounded operator 
on , with values in the finite-dimensional subspace spanned by ei , . . . , e^v • Moreover 

N 

{Pi'{oj)f,g)2= Y,iPt{c^)^i^e,){ei,f)2{ej,g)2 = {Pt{oj)UNf,UNg), f,geL\ (5.22) 

In the following we will consider P^ as a stochastic process with values in £2(^^)5 the space of 
Hilbert-Schmidt operators on L^. 

In order to approximate ^g+e we introduce 

Jn = {nl - Ay\ An = AJn, y/'"(a;) = J„y/(a;). 

Note that A^ are the Yosida approximations of the operator A. 

We are going to approximate E{Pto by E(Pj^ Y^';l^,Y^^l^)2. 

y^'" is a process with values in which admits an Ito differential that we are going to 
compute. Recall equation (|4.2p satisfied by y^, that we now re- write in the following way: for 
s > to, 

y/= r e'^'-'''^^[B{r)Y^' + 6'h{r)]dr+ I" e^'-''^'^[Cj{r)Y^' + 6'aj{r)]dW^ , ¥ - a.s. 
Jto Jto 

where B{r),Cj{r) denote the multiplication operators by the functions b' {r, Xr{-),Ur) and 
(T^ (r, ■, Xr{-),Ur) respectively. Applying J„ to both sides it is not hard to conclude that y/'" has 
the Ito differential 

dy/'" = An y/'" ds + [J„S(s)y/ + JnS'b{s)] ds + [JnCjis)Y,: + JnS'ajis)] dW^ . 

In the following for y,z E L?' , we denote by ?/ (8) z the rank-one operator / 1— )• {f,z)2y on 
L^. Using this notation we will consider the i22(-^^)- valued process y/'"" y/'", s G [to,T] 
(recall that if is a separable Hilbert space, C2{K) is the Hilbert space of all bounded linear 
operators in X for which 1 |£2(_r') ~ tr{X*X) is finite naturally endowed with the product 
{X^,X2)c,iK)=tr{XlX2)). 

By the Ito formula for Hilbert-space valued Ito processes we have 

d{Yr ^ Yr) = An (y/'" ® y/'") ds + {Yr ® y/-") ^; ds 

+y/'" ® [JnB{s)Y^ + Jn6%s)] ds + [JnS(s)y/ + JnS'b{s)] y/'" ds 

-fy/'" [JnCjis)Y,' + JnS'ajis)] dWl + [J„Cj(s)y/ + Jn5'aj{s)] ® y/''^ dWi 

+ [JnCj{s)Y^ + Jn<5Vj(s)] ® [JnCj{s)Y^ + J„5Vj(s)] ds 
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and it follows that 



,{s-r)An 



+ / e^^-'-^^-ly;'" ® [JnCj{r)Y,' + Jn<5V,(r)] + [J„Cj(r)y; + J„<5V,(r)] ® y/'^je^^"")^" dW^ 



+ r e('^-'-)^"{[J„C,-(r)y/ + Jnd'ajir)] ® [J„Cj(r)y/ + J„<5V,-(r)]}e(^-^)^" dr 

The reason for introducing the process y^'" (g) y^'" is that we can now make the following 
computation: denoting by tr the trace of operators in we have 

and we can replace {Y^^"^(SiY^^"J by the previous formula. Taking conditional expectation with 
respect to Tto the stochastic integral disappears and we obtain 



I 

J to 



pN ^{to+e-r)A^^ye,n ^ [J^B{r)Y,' + JnS%r)] 



+ [JnB{r)Y; + JnS'b{r)] y;-«}e(*o+^-OA* 



+ 



dr 



Etr 



to 
2E 



pN e(*o+-'^Mn{[j^c',(r)y; + J„5V,-(r)] ® [J„C,(r)y/ + J„5V,-(r)]}e(*<'+^~^')^" 



dr 



to+t 



+E / « e^^o+^-'-^^iJ^C.My; + J„5V,(r)],e(*»+^-'-)^"[J„C,(r)y; + J„<5V,(r)])2 dr. 

Next we let n — )- oo and we use the fact that ||e*^"/ — e*^/||2 — )• and || J„/ — /II2 — )• for 
/ G L^. It follows that 

E« y,:,+„ y,:,+,)2 = 2E /*"^'« e(*°+-'-)^[i?(r)y; + 5^6(r)], e(*"+-'-)^y/)2 dr 

-'to 



+E 



to 



e(*o+-'^)^[C,(r)y; + 5V,(r)], e(*°+-^')^[C,(r)y/ + 5V,(r)])2 dr. 



Recalling ()5.22p . this formula can be written 

fto+e 



(Pt„n^y/„+„n^y/„+,) = 2E /" '(Pi„n^e(*o+^-^)^[i?(r)y/ + 5^6(r)],n^e(*°+^-'-)^y/)dr 

to+e " 

E / ° Vton^e(*"+^-^)^[C7j-(r)y; + 5Vj(r)], n^e(*«+^-")^[Cj(r)y; + 5Vj(r)]) dr. 

^to 



We let — )• 00 and we finally obtain 

fto+e 



E{Pt, y/„+„y/„+,) = 2E / " Vto e(*o+^-^)^[i?(r)y; + 5^6(r)],e(*»+^-^')^y/) dr 

J to 

/•to+e , , , , 



+E 



'{Pt, e(*°+^-^)^[C,(r)y; + ,5V,(r)], e(*°+^-'-)^[C,-(r)y; + <5V,-(r)]) dr. 



to 
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Using the estimate in Proposition 14.11 it follows that 



J to 

and since He*"^/ — /II4 — )■ as t — )• for every / G we also conclude that 
E{Pt,Y,l^,,Y,l^,)=E r^\Pto <5V,(r),<5V,(r))dr + o(6). 

Jtn 



'to 

Therefore, in order to finish the proof of (|5.18|) . it remains to show that 



E r^\{Pr - Pto) 5V,(r),5V,(r)) dr = o(e). (5.23) 

J to 

We fix r/ G (0, 1/4). Since we have ||(5'^cjj(s)||4 < Co, for some constant Co, it follows that 

^-A)-n^a,{s) (^K:={fGL^:f€ D{-A)\ ||/b(-A). < ^o}. 

Since D{—AY is compactly embedded in L^, the set is a compact, hence bounded, subset of 
L^. We have 

|E((P, - Pt,) ,5V,-(r),5V,(r))| < E sup K(P, - P^J {-Aff, {-Aff)\. 

Since K is compact in L^, for every (5 > it can be covered by a finite number Ng of open 
balls with radius 6 and centers denoted f^,i = l,...,Ns. Since D{—A)^ is dense in L^, we can 
assume that G D{—A)'^. Given f ^ K, let i be such that ||/ — //II4 < 6; then writing 

{{Pr - Pto){-A)V, {-Aff) = {{Pr - Pt,){-A)yl {-Afff) 

-{{Pr - Pto){-Ar{f - //), {-ArU - //)) + 2{{Pr - Pto){-A)V, {-Af{f - f!)) 

and recalling the notation introduced in (IS.lip we obtain 

+ \\\Pr - Pto\\\S^ + 2\\\Pr - PtolWWfhS. 

Since K is bounded in L^, we conclude that 

sup \{{Pr - Pto) {-Aff, {-Aff) < ^ K(P,, - Pto){-Afff, {-Afff)\ 
+2 sup |||Pt||| (5^ + c sup |||-Pt|||(5, 

te[to,r] t&[to,r] 

for some constant c. Taking expectation, it follows from (I5.12p that 

- Pto) 5V,-(r), 5V,(r))| < Y^mPr - Pto){-A)Vl (-^)V/)I + c(T - r)-^^[5^ + 5], 

i=l 

for some constant c independent of e and 5. By (15. Sp we conclude that 

limsup |E((Pr - PtJ (5Vj(r), (5Vj(r))| < c(T - tQ)-'^'^[5^ + 5]. 

rito 

Letting 5 — )• we conclude that the left-hand side is zero, and (j5.23p follows immediately. 
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A Stochastic integrals in W spaces 

In this appendix we sketch the construction and some basic properties of stochastic integrals 
with respect to a finite dimensional Wiener process, taking values in an L^-space. The few facts 
collected below are enough for the present paper. 

Let (TV/, . . . , Wi)t>o be a standard, d-dimensional Wiener process defined in some complete 
probability space (17,7^, P). We denote by {Tt)t>o the corresponding natural filtration, aug- 
mented in the usual way, and we denote by V the progressive cr-algebra on Q x [0,T], where 
T > is a given number. Let := LP{D,T>,m) be the usual space, where m is a positive, a- 
finite measure and p G [2, oo). The integrand processes will be functions H : Q x [0,T] x D ^ W^, 
which are assumed to be P (8) P-measurable. When H is of special type, i.e. it has components 
of the form 

N 



W{u,t,x) = Y,hi{oo,t)f^{3 



i=l 



for j = 1, . . . , (i, /i] bounded "P-measurable, // bounded P-measurable, then the stochastic inte- 
gral It{x) is defined for fixed x £ D by the formula It{x) = /q Hi{x) dWi = ff{x) /q hl{s) dWi . 
Using the Burkholder-Davis-Gundy inequalities for real-valued stochastic integrals, we have for 
some constant Cp (depending only on p): 

Wt{xW < CpE (^^ \Hsix)\^ds^ 
where \Hs{x)\'^ = Yl'j=i l-f^s (2;)^. Since p > 2 we have, by en elementary inequality, 

mixW < Cp i^J^ iE\HsixWf^^dsj = Cp ^ \\H,ix)\\%^^.^^,^dsj . 
Integrating with respect to m we obtain, again by elementary arguments, 

lE||/t|lip(B) < cpj^ (^j\nHs{x)\Pf/Pdsy^ m{dx) < Cp (j^ (^j^nHs{x)\Pm{dx)^ ds^J 



which can be written 



or equivalently 



/ /-t \P/2 

E||/t||^,(^) < Cp ^ {E\\Hs\\l,^^.^^,//^dsj (A.l 



\It\\LP{nxD) < cl^^ ( / \\Hs\\lp(^Q^D.^H^ds 



t \ 1/2 





Finally, by standard arguments, the stochastic integral can be extended to the class olV ®T)- 
measurable integrands H for which the right-hand side of (jA.ip is finite, and the inequality (|A.ip 
remains true. 

We finally note that from (jA.ip and the Holder inequality it follows that 

< Cp [\\m\l,,^.^^,,ds (A.2) 



LP{D) - "-P ^ll-'-'sllLP(D 

Now suppose that there exist regular conditional probabilities P(-| J-f) given any J^t (this holds 
for instance if the Wiener process is canonically realized on the space of M''-valued continuous 
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functions). Then a slight modification of the previous passages shows the vahdity of the following 
conditional variant of (jA.2p : for < r < t, 

E^^\\l'HidW^X.iD)<^pl'^^'\\Hs\\l,(^^^^^^^^ (A.3) 
This is used in the proof of Proposition 15. 2[ 
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